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ABSTRACT 


Necessary  and  sufficient  conditions  for  Identl- 
flability  with  linear  coefficient  and  covarlance  restrictions 
are  developed.   In  practical  terms,  covarlance  restrictions 
aid  identification  if  and  only  if  they  imply  either  that 
(1)  a  set  of  endogenous  variables  is  predetermined  in  a 
particular  equation  (generalizing  the  notion  of  recursiveness) 
or  (11)  an  identifiable  residual  is  predetermined  in  a 
particular  equation.   In  both  cases,  restrictions  useful 
for  identification  yield  instruments  necessary  for  estima- 
tion; the  implications  for  efficient  estimation  with 
covarlance  restrictions  are  worked  out  in  a  companion 
paper:   Hausman-Taylor  (I98I). 
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1.   Introduction 

The  problems  of  identlfiabllity  and  estimation 
of  structural  parameters  in  linear  simultaneous  equations 
models  are  closely  related:   see,  e.g.,  Richmond  (1974). 
When  the  necessary  prior  Information  consists  of  linear 
restrictions  on  the  structural  coefficients  (henceforth 
"coefficient  restrictions"),  the  early  work  at  the  Cowles 
Foundation  determined  necessary  and  sufficient  conditions 
for  identlfiabllity  and  related  these  to  maximum  likelihood 
estimation,  (Koopmans,  Rubin,  and  Lelpnlk  (1950),  or 
Koopmans  and  Hood  (1953)).   For  this  case,  (coefficient 
restrictions),  the  work  was  extended  to  show  the  relation- 
ship between  Identlfiabllity  and  instrumental  variables 
estimation:   I.e.,  that  the  restrictions  required  for 
identification  give  rise  to  the  Instrum.ental  variables 
required  for  estimation,  (Fisher  (1966),  Theorem  2.7-2). 
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This  picture  is  greatly  complicated  when  restric- 
tions on  the  structural  disturbance  variances  and  covariances, 
(henceforth  "covariance  restrictions")  are  allowed.  Koopmans 
Rubin,  and  Leipnik  (1950)  recognized  the  usefulness  of 
such  restrictions  for  identification  and  demonstrated  their 
equivalence  to  bilinear  restrictions  on  the  coefficients. 
This  work  was  pursued  by  Wegge  (1965) j  Rothenberg  (1971), 
and  especially  Fisher  (1963,  1965),  surveyed  in  Fisher 
(19-66,  Chapters  3  and  4).  Structural  estimation  is  also 
complicated  by  covariance  restrictions:  as  pointed  out  by 
Rothenberg  and  Leenders  (1964),  system  instrumental  variables 
estimators  (3SLS)  are  asymptotically  inefficient  when  covariance 

i 

restrictions  are  present.  ^ 

Two  features  of  these  results  are  (i)  the  absence  of 

useful  necessary  and  sufficient  conditions  for  identifiability 

in  the  presence  of  covariance  restrictions,  and  (ii)  the 

disappearance  of  the  link  between  restrictions  required  for 

identification  and  instrumental  variables  required  for 

estimation.  The  problem  of  incorporating  covariance  restric- 
tions Into  the  theory  of  identification  and  estimation  is 

thus  Incomplete.   In  this  and  a  companion  paper  on  estimation 
(Hausman-Taylor  (1981)),  we  provide  a  simple,  complete,  and 
useful  solution  to  the  problem  In  terms  of  instrumental 
variables . 

In  the  present  paper,  we  derive  necessary  and 
sufficient  conditions  for  identifiability  in  linear  simul- 
taneous equations  models  subject  to  linear  restrictions  on 
the  coefficients  and  covariances.   The  result,  in  practical 
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terms,  shows  that  for  covarlance  restrictions  to  aid  identi- 
fication, they  must  imply  that  either  (1)  a  set  of  endogenous 
variables  is  predetermined  in  a  particular  equation  or  (ii)  an 
identifiable  residual  is  uncorrelated  with  the  disturbance 
in  a  particular  equation  and  may  be  treated  as  predetermined 
in  that  equation.   Thus  identifiability  and  the  existence  of 
Instrumental  variables  are  shown  to  be  equivalent. 

That  this  fact  is  unknown  when  covarlance  restric- 
tions are  present  can  be  illustrated  in  the  simplest  supply 
and  demand  example.   Suppose  Income  is  excluded  from,  the 
supply  curve,  so  that 


yi  =  ^12^2  -^  -^11^1  ^  ^ 


^2  "  ^21^1         "*■  ^2' 


where  y.,  denotes  equilibrium  production  and  consumption, 
^2   denotes  the  equilibrium  price,  and  z,  denotes  exogenous 
Income.   Using  only  the  prior  information  on  the  structural 
coefficients  (Yp-i  =  0);  the  supply  curve  is  identifiable 
and  z,  provides  the  necessary  Instrument  for  estimating  ^^i' 
Using  only  coefficient  restrictions,  the  demand  curve  is 
not  identifiable  and  there  are  not  enough  instruments  to 

estimate  3-,2  ^^^  "^11" 

Suppose,  in  addition,  cov(u  ,U2)  =  a^j  ~  '-'•  ^°^ 
the  reduced  form  parameters  are  given  by 


-   H  - 


n  = 


1-3^2^21 


Y 
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^21^11 


^    = 


a^^+B^2'^22 


^21^11-'^12^22 


^21^1l'*"^12^22    ^21^1l'^^22 


'^ll    "12 


0)21    "22 


in  standard  notation,  and  we  can  recover  all  of  the  structural 
parameters  from  consistent  estimates  of  the  reduced  form: 


hi   '   "2''"l 


yN  /V 


B 


^  ^2l"ll~"l2 
^2l"l2-"22 


^11  =  ^l(l-^12^2l) 


Thus  the  restriction  a^p  =  0  makes  the  demand  equation 
identifiable,  yet  there  appears  to  be  insufficient  instru- 
ments to  calculate  the  2SLS  estimator  of  (3-|2jTn-|)- 

To  resolve  this  problem,  it  is  important  for 
expository  purposes  to  proceed  systematically.   In  Section  2, 
we  set  out  the  notation  and  the  model.   We  begin  with  the 
limited  information  case  in  Section  3,   permitting  linear 
restrictions  on  the  coefficients  and  disturbance  covariances 
in  the  first  equation.   This  reproduces  the  familiar  results 
from  the  Cowles  Commission  analysis  and  from  Fisher  (1966), 
Chapters  2  and  3j  albeit  from  a  different  point  of  view. 
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The  main  results  are  in  Sections  ^  and  5  in  which,  first, 
zero  restrictions  and  then  general  linear  restrictions  on 
the  system  coefficients  and  covariances  are  appended.   This 
completes  and  extends  the  results  in  Fisher  (I966),  Chapter  4, 
and,  in  our  opinion,  constitutes  a  satisfactory  solution  to 
the  problem  of  identification  in  linear  models  with  linear 
coefficient  and  covariance  restrictions. 
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2.   The  Linear  Model 

Consider  the  classical  simultaneous  equations  model 

(2.1)  YB  +  zr  =  U 

In  which  Y  Is  a  TxG  matrix  of  observations  on  the  G  jointly 
dependent  random  vectors  y.  (1=1,..., G)  and  Z  Is  the  T^K 
matrix  of  observations  on  the  K  variables  which  are  predeter- 
mined In  every  equation:   I.e.,  pllm  =■  Z'u.  =  0,  where 

T-»-o°       1   ~ 
U  =  [u^j...,Uq].   The  structural  disturbances  u.  are  assumed 

Independent  and  Identically  distributed,  but  contemporaneously 
correlated  across  equations.   Thus  cov(U.)  =  Z  (j=l,...,T), 
where  U.  is  the  J'th  row  of  U  and  Z  Is  a  positive  semi-deflnlte, 

J 

symmetric,  GxG  matrix,  which  may  be  singular  to  accommodate 
identities  among  the  structural  equations. 

Imposing  exclusion  restrictions  and  the  normaliza- 
tion ^..    =   1    (1=1,..., G),  equation  (2.1)  becomes 

(2.2)         y^  =  X^6^  +  u^    (1=1,. ..,G) 

where,  in  the  usual  notation,  X.  =  [Y.  :Z.]  and  6.  =  [B,-:y.] 
so  that  6.  represents  the  (g^^-l)  +  k.  coefficients  in  the 
I'th  structural  equation  which  are  unknown,  a  priori. 
Without  loss  of  generality,  we  will  be  concerned  with  the 
identlfiability  of  the  unknown  parameters  [3-,  ,Y-|  jCJ-i -i  ]  in 
the  first  structural  equation, 
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which  is,  of  course,  equivalent  to  the  identif lability  of 
a^^   and  the  first  column  of  B  and  T:      i.e.,  of  [B.  ,  r,  ,o-, -,  ] 

Since  B  is  non-singular,  equation  (2.1)  can  be 
solved  to  yield  the  reduced  form  equations 


Y  +  ZFB"-^  =  UB"""" 


or 

(2.3)  y  =  zn  +  V 

where  the  reduced  form  parameters  II  and  Q,  =   cov(V)   are 
related  to  the  structural  parameters  by 

(2.4)  n  =  -Vb~^ 

(2.5)  f2  =  (B'  )"^ZB"^. 

Since  E(Y|Z)  =  Zn   and   cov(Y|Z)    =  Q,    the  reduced  form 
parameters  are  identifiable  from  observations  on  Y  and  Z 
provided  only  that  Z  is  of  full  rank,  which  we  assume. 
Moreover,  the  Jacobian  of  the  transformation  from  U  to  V 
is  non-vanishing,  so  that  the  structural  parameters  (B,r,Z) 
are  identifiable  from  observations  on  Y  and  Z  if  and  only 
if  (B,r,Z)  are  uniquely  determined  in  equations  (2.4)  and 
(2.5),  given  (n,f^)  and  whatever  prior  information  on  [B,r,E] 
that  we  are  prepared  to  assume.   In  particular,  for  the 
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parameters  of  the  first  structural  equation  to  be  Identi- 
fiable, It  is  necessary  and  sufficient  that  equations  (2.4) 
and  (2.5)  admit  of  a  unique  solution  for  [B-,  ,r,  ,a-, -,  ] , 
given  (II,J^)  and  prior  information  on  [B,r,E]. 

Let  us  now  Isolate  those  parts  of  equations  (2.4) 
and  (2.5)  which  actually  restrict  the  parameters  of  the 
first  structural  equation. 
Lemma  1 :   Treating  (B^TjE)  as  unknowns,  the  equation  systems 

ne  =  -r 

(2.6) 

fiB  =  (B' )~^Z 

and 


(2.7) 


HB^  =  -r, 


nB^  =  (B')"^i:^ 


*     *     * 


have  the  same  solutions  (B,  ,r  ,Z-,) 
Proof:   Rewrite  equations  (2.6)  as 


nB^  =  -r. 


B'f2B.  =  Z. 


i  —  1,...,G 


%   X   X 

and  observe  that  [B-j^,r^,Z^]  solves  (2.6)  if  and  only  if  it 
solves 
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nB^  = 


^2 

• 

• 

-r. 


Q.B.    =    Z. 


by  the  symmetry  of  ft.   This,  in  turn,  is  equivalent  to 
equations  (2.7). 

The  principal  mathematical  tool  for  examining 
the  uniqueness  of  solutions  to  linear  equation  systems  is 
the  following. 
Lemma  2 :   If  Ax  =  b  is  a  consistent  set  of  linear  equations, 

all  solutions  x*  are  of  the  form 


X*  =  A"^b  +  [I-AA^]C 


for  any  vector  E,,    where  ()   denotes  any  generalized 

inverse. 
It  follows  from  this  that  x*  is  unique  if  and  only  if  the 
dimension  of  the  null  space  of  A  is  zero.   The  fact  that  the 
existence  of  a  unique  solution  to  a  set  of  linear  equations 
turns  out  to  characterize  the  identification  problem,  (despite 
the  fact  that  equation  (2.7)  is  not  linear  in  B-,),  prompts 
the  following  definition. 
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Definition:   A  restriction  on  the  structural  parameters  will 
be  said  to  be  useful  for  Identification  If  and 
only  If  it  reduces  the  dimension  of  the  null 
space  of  A  in  the  relevant  system  of  linear 
equations. 


For  future  reference,  we  denote  the  null  space  of  a  matrix 
A  by  W(A)j  its  column  space  by  C(A),  the  orthogonal  projec- 
tion operator  onto  C(A)  by  P   ,  and  the  projection  operator 


onto  W(A)  by  I  -  P^  =  Q^, 
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3.   Limited  Information 

In  this  section,  we  confine  our  prior  Information 
to  linear  restrictions  on  the  parameters  of  the  first  struc- 
tural  equation,  including  E-,  =  (a-. -,  ,a-,  p  j  •  •  •  jO-,  q)   with  these 
parameters  in  Section  3-2.   The  results  correspond  to 
Chapters  2  and  3  of  Fisher  (1966)  but  from  a  different 
point  of  view. 
3.1  Linear  Restrictions  on  (B-,,r-,) 

This  is  the  classical  case,  treated  at  length  in 
Koopmans  and  Hood  (1953)  and  in  Chapter  2  of  Fisher  (1966). 
The  prior  information  on  (B-,,!-,)  is  written  as 


(3.1) 


■^1^ 


•-  r 


where  $  is  an  rx(G+K)  matrix  of  known  constants  and  <}>  is  a 
known  r  vector.   Since  I   is  entirely  unknown,  the  only 
restrictions  placed  on  (B-,,r-,)  in  equations  (2.4)  and  (2.5) 
are  those  from 


(3.2) 


nB,  =  -r^ 


and  the  prior  restrictions  in  equation  (3.1).   Thus  (B^,r,) 
are  identifiable  in  equations  (3.1-3.2)  if  and  only  if 


'n  :  I' 


"B- 


-  *  J  Lr^. 


L(}>J 
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has  a  unique  solution  for  (B-,,r^).   A  necessary  and  suffi- 
cient condition  for  this  is  that 


rank 


n  :  I' 


$ 


>  G+K 


and  a  necessary  condition  is  that  r  _>  G,  so  that  the  above 
(K+r)x(K+G)  matrix  of  restrictions  has  at  least  K+G  rows. 
The  familiar  counting  rules  are  specializations  of  this 
result  for  the  case  of  exclusion  restrictions  and  the 
normalization  B-i-i  =  !•   Here,  the  unknown  coefficients  in 
the  first  equation  are  (B-i,Y-|)  in  equation  (2.2),  and 
these  are  identified  if  and  only  if 

^12^1  "  9 

has  a  unique  solution  for  B-,  ,  where  H-,-  is  the  submatrix 
of  n  which  relates  the  endogenous  variables  included  in 
the  first  equation  (Y, )  with  the  excluded  predetermined 
variables. 

For  completeness,  note  that  a,,  is  identifiable 
provided  B-j^  is  identifiable,  since  a-,,  =  B-,nB,  from 
equation  (2.7). 
3.2   Prior  Information  on  (B-,,r,,E,) 

Since  Z-,  is  at  least  potentially  known,  identifi- 
cation of  the  parameters  of  the  first  structural  equation 
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depends  upon  the  number  of  solutions  (B,,r^,I,)  to  equation 
(3.2)  and 

(3.3),  QB^   =  (B')~^2:-L 

given  the  coefficient  restrictions  (3.1)  and  covarlance 
restrictions  on  Z-,.   If  elements  of  the  vector  (B')~  Z 
are  known,  equation  (3.3)  places  additional  restrictions  on 
the  solutlon(s)  to  equations  (3.2)  and  (3.3).   Such  infor- 
mation is  thus  useful  for  identifying  B,,  and,  through 
equation  (3.2),  T-..      In  general,  though,  information  on 
(B-,,r,,Z-,)  is  not  enough  to  determine  any  element  of 
(B')~  Z.,  uniquely.   Indeed,  since  every  element  of  B~   is 
a  function  of  elements  of  B.  (1=2,..., G)  -  about  which  we 
know  nothing  -  equation  (3-3)  Is  useful  for  identification 
of  B-|  if  and  only  if  our  prior  information  about  Z,  is  that 
Z-,  =  0.   In  particular,  two  interesting  special  cases  yield 
no  useful  information  for  identification  purposes:   (1)  Z,  7^  0 
entirely  known,  and  (11)  Z-,  =  (o^^    0  0  ...  0)'.   In  both  cases, 
the  right  hand  side  of  equation  (3.3)  is  an  unknown  vector, 
so  that  the  equation  does  not  restrict  the  set  of  solutions 
to  equations  (3.1-3.3). 

The  only  case  of  Interest  in  this  section  is  thus 
•I-l  =  0,  which  implies  that  0-,-,  =  0  so  that  the  first  structural 


disturbance  is  identically  zero.   Now  (B')   Z-,  is  known  and 


equation  (3.3)  must  be  added  to  the  restrictions  on  B,: 
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Proposition  1:   (B-,,r^)  are  identifiable,  using  only  prior 


restrictions  on  (B-,,r,)  and  a,-,  =  0,  if  and 


only   i 

f 

rn   :   I 

rank 

$ 

Q    :    0 

>  G+K, 


Proof:   Denote  the  matrix  in  question  by  D.   A  necessary  and 
sufficient  condition  for  the  equation 


■^l" 

= 

"O" 
4> 

[rj 

.0. 

D 


to  have  a  unique  solution  (B-,,r-,)  is  that  rank(D)  _>  G+K, 
the  number  of  unknown  parameters. 

This  is  equivalent  to  the  Generalized  Rank  Condi- 
tion (Theorem  3-8.1)  of  Fisher  (I966).   This  will  always 
hold  in  the  case  in  which  rank(J^)  =  rank(Z)  =  G-1,  and  for 
every  additional  drop  in  the  rank  of  Z,  the  order  condition 
will  require  an  additional  restriction  on  the  coefficients 
of  the  first  equation.   This  follows  from  the  fact  that  the 
dimension  of  the  row  space  of  D  is  K  +  r  +  rank(f2)  so  that 
the  Proposition  reduces  to  r  >_  G  -  rank(n). 

Some  intuition  is  gained  by  specializing  this 
result  for  exclusion  restrictions  and  the  usual  normalization. 
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The  first  structural  equation  is  thus 


y,  =  X,  6.  +  u 


'1 


1"1 


^1 


where  the  only  additional  restriction  is  a-,-,  =  0,  or  u-,  =  0, 
Without  loss  of  generality,  assume  the  first  g-,  elements  of 
B-,  are  non-zero  and  that  the  reduced  form  covariance  matrix 
corresponding  to  Y, : 


n  = 


UUT  T  o6t   /^ 


_i6/^"i  aC  ^  /~\ 


=    [n-^:fi2^ 


is  partitioned  accordingly.   Specializing  Proposition  1,  we 

immediately  obtain 

Corollary  1.1:   When  a-.-.    =  0,  a  necessary  and  sufficient 

condition  for  the  identification  of  6-,  above 

is  that 


rank 


^12 


>  gl  -  1. 


As  before,  the  equation 


'12 


.^1  J 


6n  =  0 
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provides  (K-k-,)  +  rank(Ji-,)  restrictions  on  B-,  ,  so  that  a 
necessary  condition  for  the  identifiability  of  6-,  is  that 
(K-k,  )  +  rank(f2-,  )  >_  g-j^  -  1,  or  equlvalently , 
Corollary  1.2:   A  necessary  condition  for  the  identifi- 
ability of  3,  is  that  rank(fi,  )  >_  (g, -1)  - 
(K-k-j):   i.e.,  that  the  rank  of  Q-.    exceed 
the  nominal  degree  of  underidentificatlon, 
based  on  exclusion  restrictions. 
Note  that  Q-,  is  a  Gx(g,-1)  matrix  of  rank  less  than 
g,  -  1;  one  can  show  that  if  rank(fi-,  )  =  g,  -  1,  g,  =  0  and 
the  first  equation  must  be  a  reduced  form  equation.   If  the 
rank  of  Z  and  thus  fi  is  G-1,  the  above  order  condition  is 
fulfilled,  even  In  the  absence  of  coefficient  restrictions. 
Indeed,  Fisher  (Theorem  3.9.1,  (1966))  shows  that  $-,  is 
identifiable  in  this  peculiar  non-stochastic  case,  provided 
only  that  X^  is  of  full  rank. 

An  alternative  explanation  of  this  last  result  is 
suggestive  for  the  more  serious  cases  to  come.   Since 
Z-,  =  0,  pllm  rp  y.u-,  =  0  (1=1,..., G),  so  that  every  endogenous 
variable  is  predetermined  in  the  first  equation  and  can  be 
used  as  an  instrument.   The  two  stage  least  squares  (2SLS) 
estimate  of  6-,  thus  corresponds  with  least  squares  (OLS);  and 
we  should  expect  6-,  to  be  identifiable  whenever  regression 
coefficients  are  identifiable  in  ordinary  single  equation 
situations.   Note  that  this  will  fall  If  any  other  structural 
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disturbance  corresponding  to  endogenous  variables  present 
in  the  first  equation  is  identically  zero,  since  the 
"Instruments"  are  then  formally  uncorrelated  with  the  Included 
endogenous  variables. 
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4.   Exclusion  Restrictions  on  B 

We  now  consider  prior  Information  about  structural 
coefficients  from  equations  other  than  the  first.   To  our 

linear  restrictions  on  (B,  jf.,)  and  zero  restrictions  on  Z-,  , 

2 
we  append  knowledge  that  certain  elements  of  B  are  zero. 

4.1   Relative  Triangularity 

To  determine  what  type  of  exclusion  restrictions 

on  B  and  Z,  are  useful  for  identifying  (B-,,r-,),  we  must 

examine  the  structure  of  B.   The  following  assumptions  will 

be  maintained  throughout: 

(I)  B  is  non-singular J  B..  =  1; 

(II)  certain  elements  of  B  are  zero  and  the  remainder  are 
unrestricted;  and 

(ill)   sums  of  products  of  non-zero  elements  of  B  are  non-zero, 
The  last  assumption  rules  out  events  of  measure  zero  in  the 
parameter  space  and  ensures  that  minors  of  B  can  be  zero  only 
be  appropriate  zero  restrictions  in  assumption  (11). 
Definition:   For  a  GxG  matrix  B,  a  chain  product  correspond- 
ing to  the  i'th  row  and  the  j ' th  column  is  a 
product  of  no  more  than  G-1  elements  of  B  of 
the  form 


^la^ab^bc--^fj 


where  all  Indices  are  distinct.   The  set  of  all 

such  chain  products  is  denoted  Br.  . -i . 

L-i-jJ  J 
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A  chain  product  has  a  number  of  useful  properties: 
(i)   If  B.^  denotes  the  submatrix  of  B  obtained  by  deleting 
the  J'th  row  and  the  i'th  column,  all  elements  of  B..  and 
only  elements  of  B,.  appear  among  the  products  in  Br.  . -| . 
(ii)   No  element  of  Br^  . -■  contains  a  shorter  element  of 
Br.  .-]»  since  no  elements  come  from  the  j'th  row  of  B. 
(iii)   In  a  given  chain  product,  each  index  (except  i  and  j) 
appears  exactly  once  as  a  row  index  and  once  as  a  column 
index.   For  example,  for  a  4x4  matrix  B, 


^[2,4]  "  ^^2i|'^21^l4'^23^34'^21^13^34'^23^31^l4^' 


The  notion  of  a  chain  product  is  central  to  the 
idea  of  relative  triangularity,  which  turns  out  to  be  the 
feature  of  the  B  matrix  which  is  relevant  for  identification. 
Definition:   Equations  (i,j)  are  relatively  triangular  if 
and  only  if  Br.  . -i  =  {0}.   Equations  (i,j) 
relatively  triangular  does  not  imply  that 
equations  (j,i)  are  relatively  triangular. 
The  name  is  motivated  by  the  observation  that  B  is  triangular 
if  and  only  if  equations  (i,j)  are  relatively  triangular  for 
all  i  <  j.   Thus  for  the  4x4  case,  B  is  triangular  if  and 
only  if 

^12  "  ^13  "  ^14  "  ^23  "  ^24  =  ^34  "  ° 
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which  Is  necessary  and  sufficient  that  equations  (1,2), 
(1,3), (1,^), (2,3), (2,4),  and  (3,4)  are  relatively  triangular, 

Relative  triangularity  and  the  intuitive  notion 
of  feedback  are  closely  connected.   For  example,  consider 

yi  =  ^12^2  -^  ^13^3  ""  ^11^1  ^  ""i 

^2  =  ^23^3  ""  ^21^1  +  ""2 

^3  =  ^32^2         -^  ^31^1  ■"  ^3- 

The  first  equation  has  a  peculiar  relationship  to  the  rest 
of  the  system,  in  the  sense  that  the  variables  (yp,yq)  are 
simultaneously  determined  in  the  second  and  third  equations 
with  no  direct  feedback  from  the  first.   Indeed,  one  can 
readily  check  that  Br-,  -, -.  =  Brp  -, -i  =  {0}  so  that  equations 
(3,1)  and  (2,1)  are  relatively  triangular. 

The  set  Br.  . -i  details  the  paths  by  which  a  shock 
to  y .  is  transmitted  to  y. .   In  the  previous  example, 

Br-,  oi  =  {B-i  qj  3-T  p^?'^-^ '  ^^^  since  we  have  imposed  the  nor- 
malization 6..  =  1,  a  shock  to  u  is  transmitted  directly 
to  y-,  in  the  third  equation.  The  shock  to  y-,  perturbs  y-, 
in  the  first  equation  in  two  ways:  directly,  since  B,  ^  ?f  0 
and  indirectly  through  the  second  equation  since  both  3-,p 
and  ^2-^  j^   0 

Somewhat  surprisingly,  the  notion  of  relative 
triangularity  of  equations  (i,j)  is  precisely  equivalent 
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to  a  zero  in  the  (l,j)'th  position  of  (B' )~"'",  denoted 


:0-l  = 


Lemma  3:   ^^'^ij  =  0  if  and  only  if  equations  (i,j)  are 

relatively  triangular. 
The  proof  appears  in  Appendix  A.   In  the  previous  example. 


B' 


"1 

-6,2 

-^13" 

0 

1 

B23 

.  0 

Boo 

1  . 

so  that 


(B')"^  = 


I-632B23 


■1-332623 


^12"^13^32        ^13"^12^23 


L 


0 
0 


1 

-B 


32 


-B 


23 


J 


which  has  zeros  in  positions  (2,1)  and  (3,1)- 

The  relative  triangularity  of  equations  (i,j)  is 
obviously  a  necessary  condition  for  y.  to  be  uncorrelated 

J 

with  u  and  thus  to  be  predetermined  in  the  i'th  equation. 
However,  as  in  the  case  of  full  triangularity,  something 
further  must  be  said  about  the  disturbance  covariances 
before  this  information  is  useful  for  identification. 
^.2  Relative  Recursiveness 

We  wish  to  determine  when  zero  restrictions  on 


(B,I, )  restrict  solutions  (B,,?,,!,)  to 
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(4.1) 
(4.2) 


nB,  =  -r^ 


QB^    =    (B'  )~''"S^ 


given  the  coefficient  restrictions 


(4.3) 


B. 


=  <j>. 


If  all  elements  of  the  G  vector  (B')~  2-,  are  unknown, 
despite  prior  restrictions  on  (B,Z-,),  then  only  equations 
(4.1)  and  (4.3)  are  relevant  for  identification,  and  we  are 
back  in  the  world  of  Section  3.I.   Under  our  current 
assumptions,  if  elements  of  (B')~  Z-,  are  known,  they  must 
be  zero.-^  Formalizing  this,  let  the  selection  matrix  ^   be 


the  appropriate  sxG  submatrix  of  the  identity  I 


G' 


Lemma  4 :   Zero  restrictions  on  (B,Z-,)  are  useful  for  iden- 
tification if  and  only  if  they  imply 


'l'(B'  )~"'"J:-l  =  0, 


In  order  for  the  j'th  element  of  (B')   Z,  -  which 
we  denote  by  ((B')~  T.^)  .    -   to  be  zero,  we  need  zeros  in  the 
appropriate  places  of  (B')~  and  Z,.   Assuming  a,-,  ¥   0, 
Proposition  2:   ( (B' )~'''Z-,  )  .  =  0  if  and  only  if 

J.   J 

(1)   equations  (j,l)  are  relatively  tri- 
angular, and 
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(11)  u^  Is  uncorrelated  with  every  u,^  for 
.  which  equations  (k,l)  are  not  rela- 
tively triangular. 
Proof:   In  general,  these  conditions  ensure  that  every  term 
in  the  summation  that  determines  ( (B' )~"''Z,  )  .  Is  zero. 
Specifically,  let  Br.  ^n  8  a^^  denote  the  set  of  products 
of  each  element  of  Br.  ^-j  with  o^^    (k=l,...,G);  the  Proposi- 
tion can  then  be  restated  as  ((B')~  I,).  =  0  If  and  only  If 
Br.  ^-j  8  a^^   =    {0}.   Now  ( (B '  )~-'-E^)  .  =  0  Is  the  inner  product 
of  the  j'th  row  of  (B')~  with  Z-,.   Since  sums  of  non-zero 
terras  are  assumed  to  be  non-zero,  ((B')~  Z, ) .  =  0  if  and  only 
if  ((B')~^).^  /   0  implies  a^^   =  0  for  all  k  =  1,...,G;  and 
this  Is  equivalent  to  Br.  ,  -,  0  a,  ,  =  {0}  by  Lemma  3. 

Note  that  the  condition  on  Z-,  is  less  restrictive 
than  a-,.  =  0  (1=2,..., G),  which,  for  the  entire  system, 
would  imply  diagonality  of  Z^.   In  particular,  a,,  need  not 
be  zero,  provided  equations  (k,!)  are  relatively  triangular. 

Since   3--,-  =  1    ,  a.-,  must  equal  zero  for  ((B')~-^Z,).  =  0. 
«J  <J  J  -L  -'-J 

If  equations  (i,j)  are  such  that  ( (B' )~"'"Z.  )  .  =  0  for  all 
i  <  j  =  2,...,G,  the  system  of  equations  is  fully  recursive, 
which  motivates  the  following 

Definition:   Equations  (1,J)  are  relatively  recursive  if 
and  only  if  ((B')"^Z^).  =  0. 
Intuitively,  equations  (l,j)  are  relatively  recur- 
sive if  and  only  if  there  are  no  paths  by  which  a  shock  to  u 
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can  be  transmitted  to  y..   In  our  previous  example,  equations 
(3,1)  and  (2,1)  were  relatively  triangular.   If  0-.2   =   0  but 
a-,0  ^   0,  shocks  to  u   cannot  reach  y2,  but  affect  y-,  through 
the  correlation  with  u    Thus  equations  (2,1)  are  relatively 
recursive  and  equations  (3jl)  are  not. 

Thus  equations  (j,l)  relatively  recursive  suggests 
that  y.  is  uncorrelated  with  U-,  and  can  be  considered  to  be 
predetermined  in  the  first  equation.   This  is  precisely 
correct,  as  noted  in  Fisher  (I966,  Chapter  4). 
Proposition  3:   Equations  (j,l)  are  relatively  recursive  if 

and  only  if  y.  is  predetermined  In  the  first  ■ 

J 

equation. 

Proof:   Since  plim  ^  Y'U  =  pllm  ^  n'Z'U  +  plim  ^  (B'~-^)U'U  = 

T-+-00  T^oo  T-»-<» 

(B')"-'-Z,  it  follows  that  ((B')"^E,),  =  ((B')~^I).n  =  0  if 

1       ' 
and  only   if  pllm  m    y,-u,    =   0. 
T->oo     ■'■      -J    -■- 

Summarizing  to  this  point,  we  have  shown  that  zero 
restrictions  on  (B,Z-,  )  are  useful  for  identification  if  and 
only  if  they  are  equivalent  to  a  set  of  endogenous  variables 
being  predetermined  in  the  first  equation.   Before  formally 
analyzing  identlf lability  in  these  circumstances,  we  might 
well  ask  where  this  type  of  prior  information  is  to  come  from. 

In  a  sense,  the  information  that  ^(B')"  Z,  =  0  is 
no  more  arcane  than  the  information  that  plim  fjt  Z'U  =  0.   As 
pictured  by  Fisher  (I966,  p.  101),  the  list  of  exogenous 
variables  (Z)  in  our  model  is  derived  from  the  block-recursive 


-  25  - 

structure  of  the  "universe-embracing"  equation  system  that 
determines  all  economic  variables.   If  It  Is  reasonable  to 
possess  the  knowledge  that  Z  Is  predetermined  In  every 
equation  In  the  model.  It  Is  surely  no  less  reasonable  to 
know  that  an  endogenous  variable  Is  predetermined  In  a 
particular  equation  In  the  model.   The  prior  Information  in 
this  section  simply  extends  the  block-recursive  structure 
used  to  justify  the  exogeneity  of  Z  to  a  relatively  recur- 
sive structure  which  justifies  treating  y.  as  predetermined 
in  the  first  equation.   A  priori,  there  is  no  reason  why 
the  first  type  of  prior  information  should  be  reasonable 
but  the  second  arcane. 
4 . 3   Identification  with  Exclusion  Restrictions 

Having  zero  restrictions  on  (B,Z-,),  Identifiability 
of  the  parameters  of  the  first  equation  reduces  to  the  unique- 
ness of  solutions  (B-,  jf-,  ,Z-,  )  to 

(4.4)  EB^  =  -r^ 

(4.5)  fiB^  =  (B')"^Z^ 
given 


(4.6) 


'^1 


h 


=  (}),  and 


(4.7)  ^^B^  =  ^(B'  )  ■'■Z^  =  0, 
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We  wish  to  treat  this  as  a  system  of  linear  equations  In 

(B-,  jT-,  ,!-,  )  subject  to  linear  constraints;  however,  the 

presence  of  (B')~   In  equations  (4.5)  and  (4-7)  appears 

to  rule  this  out.   On  the  contrary,  we  shall  show  that  the 
solutlon(s)  B-,  to 

H'J2B^  =  0 
subject  to  HiB')'-^^      =  0 

are  Identical  to  the  unrestricted  solutlon(s)  B-,  to 

TJ2B^  =  0. 

Intuitively,  this  works  because  the  coefficients  of  the 
first  equation  (B-,  )  are  Irrelevant  In  determining  If  equa- 
tions (j,l)  are  relatively  recursive.   Formally, 
Lemma  5  '•      For  any  Z-,,   (B')~  Z,  =  0  is  consistent  with  any 

value  of  B,  . 
Proof:   ( (B' )~''"Z,  )  .  =  0  <;==>  Br.  vn  ®  cfvi  =  ■fO^  by  Proposi- 
tion 2.   Now  Br.  -,-1  contains  no  elements  of  B-,,  so 
Br.  -,-,  =  {0}  does  not  restrict  B-,  .   Similarly,  for  k  7^  1, 
Br.  ,  1  8  a, -,  =  {0}  does  not  restrict  any  element  of  B-,  since 
any  element  of  B-,  in  a  Br.  ,  -1  chain  product  must  be  preceded 
by  a  Br.  -,-1  chain  product  which  we  know  to  be  zero. 

In  our  example,  equations  (2,1)  are  relatively 
recursive  since  a-,2  =  0  and  Brp  -i-i  =  {Pp-i  j  BpoBo-i  ^  -  i^^  ■ 
Neither  of  these  conditions  Involve  B-,  =  (1  B^p  ^19^ '*   ^® 
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may  thus  treat  ^'QB-^   =  0  as  a  linear  function  of  B,  and  ask 
If  the  coefficient  restrictions  ^  and  the  covarlance  restric- 
tions T  are  adequate  to  determine  (B-,,r.)  uniquely. 
Rewriting  the  system  as 


r- 


l" 

A' 

= 

'o' 

0 

irj 

0 

we  obtain  necessary  and  sufficient  conditions  for  the  identi- 
flability  of  the  parameters  of  the  first  equation,  given 
linear  coefficient  restrictions  on  (B-,jr,)  and  zero  restric- 
tions on  (BjZ-,).   This  is  a  new  result,  not  found  in  Fisher 
(1966),  and  in  our  opinion,  it  represents  the  solution  to  the 
problem  of  identification  with  covarlance  restrictions: 
Proposition  k    (rank) :   A  necessary  and  sufficient  condition 
for  the  identlfiability  of  (B^,r^)  using 
linear  restrictions  on  (B, ,r,)  and  zero  res- 
trictions on  (BjE-,)  is 


rank 


n 

• 

l" 

^j^ 

• 

0 

0 

>  G  +  K, 


The  three  block  rows  of  the  matrix  in  question  have  dimensions 
Kx(G+K),  rx(G+K)  and  sx(G+K)  respectively.   For  the  matrix 
to  have  rank  G+K,  K+r+s  must  be  greater  than  or  equal  to  G+K. 
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Corollary  4.1  (order):   A  necessary  condition  for  identi- 
flability  in  these  circumstances  is  that  the 
number  of  endogenous  variables  not  exceed  the 
number  of  restrictions:  r+s  >_  G. 
Specializing  these  results  to  the  familiar  case  of 

exclusion  restrictions,  we  obtain 


"12' 


B^  =  0 


where  CI-.    is  defined  above  Corollary  1.1.   Thus  for  exclusion 
restrictions. 

Corollary  4.2  (rank):   The  parameters  of  the  first  structural 
equation  are  identifiable  if  and  only  if 


rank 


^12 


1  Si  -  1; 


1" 


and 

Corollary  4.3  (order):   A  necessary  condition  for  identi- 
fiability  is  (K-k-j^)  +  s  >  g^  -  1 :   that  the 
number  of  explanatory  endogenous  variables 
not  exceed  the  number  of  excluded  exogenous 
variables  plus  the  number  of  covariance  res- 
trictions . 
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A  similar  interpretation  in  terms  of  instruments 
for  the  case  of  general  linear  coefficient  restrictions  is 
easily  obtained.   The  coefficient  restrictions  <J>  effectively 
reduce  by  r  the  dimension  of  the  space  spanned  by  the  explana- 
tory variables  corresponding  to  unconstrained  coefficients, 
(see  Appendix  B) .   The  restrictions  ^   add  s  columns  of  Y  to 
the  K  columns  of  Z  v;hich  are  predetermined  in  the  first 
equation.   In  order  to  have  as  many  instruments  as  explana- 
tory variables  in  the  first  equation,  we  thus  need  r  ahd  s 
restrictions  such  that  K  +  G-r_<K  +  S.   Using 
Corollary  ^.1,  we  obtain 
Proposition  5  (order):   A  necessary  condition  for  the 

identifiability  of  (B^,r^,Z^)  given  $  and  "i 
is  that  the  number  of  unconstrained  coeffi- 
cients in  the  first  equation  not  exceed  the 
number  of  instrumental  variables  for  the 
first  equation. 
For  the  corresponding  rank  condition,  we  show  that 
identification  is  equivalent  to  the  existence  of  the  2SLS 
estimator,  using  exogenous  and  predetermined  endogenous 
variables  as  instruments.   By  the  argument  in  Appendix  B, 
we  can  limit  ourselves  to  exclusion  restrictions  $  without 
loss  of  generality.   Let  the  matrix  of  instruments  for  the 
first  equation  be 
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W  =  [Y1"  :Z] 

and  recall  that  the  2SLS  estimator  must  invert  the  matrix 
X'[Y^:Z^]  where  Y-j_  =  P^Y^  and  Z^  =  P^Z^. 

Proposition  6  (rank):   Rank  [Y^:Z^]  =  g^  -  1  +  k-j^  if  and 
only  if 


rank 


^12' 


=  Si  -  !■ 


Proof:   Note  first  that 


plim  ^  W'V^  = 

T-»-oo 


plim  ^  ^Y'V, 


plim  i  Z'V. 


¥f2. 


L  0 


where  V-,  is  the  reduced  form  disturbance  corresponding 
to  Y,  : 


^1  "  ^1^11  "^  ^2^12  ■*■  "^1" 


Projecting  this  equation  onto  C(w),  we  obtain 


(4.8) 


Vi  =  ^^n,,  +  z^n^^  ^   V- 


Now  suppose  the  rank  condition  fails,  so  that  there  exists 
a  g,  -  1  vector  X  j^   0   such  that 
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^12 


H'fJ-,. 


X  =  0. 


Postmultiplylng  equation  (4.8)  by  A,  we  see  that 


Vl^  =  Zi^ii^  +  0 


SO  that  Y-j^  (=P^Y^)  and  1-^   are  linearly  dependent.   In  the 
other  direction,  suppose  there  exist  (g-,-1)  and  k-,  vectors 
K-^,^2    ^^^^  "^^""^  ^1^1  "*"  ^1^2  ^  °"   Since  P^  =  I  -  Q^, 


^1^1  -^  ^1^2  -  Vl^l  =  ° 


where  QyY,  =  QyV.,  since  Z^  and  Zp  are  elements  of  C(W). 
Adding  this  to  the  first  structural  equation,  we  obtain 


^1  =  ^i^^i-'^i)  +  Zi(C2+Yi)  +  yi  -  Q^Vi^i 


which  is  observationally  equivalent  to  the  first  structural 
equation.   Thus  the  parameters  (6-,  jYn  jCfn  n  )  are  not  identi- 
fiable and  by  Corollary  4.2, 


rank 


[^12 


.'i'f^. 


<  gl  -  1, 


which  completes  the  proof. 

The  intuitive  correspondence  between  restrictions 
for  identification  and  instruments  for  estimation  is  stated 
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precisely  in  Proposition  6.   Fisher  (I966,  Theorem  2.7.2) 
showed  that  for  coefficient  restrictions,  identification 
was  equivalent  to  the  existence  of  2SLS,  using  all  exogenous 
variables  as  instruments.   Our  Lemma  4  shows  that  zero  res- 
trictions on  (BjZ-,)  are  useful  for  Identification  if  and 
only  if  they  are  equivalent  to  particular  endogenous  var- 
iables being  predetermined  in  the  first  structural  equation. 
Proposition  6  then  shows  that  identification  is  equivalent 
to  the  existence  of  the  2SLS  estimator  which  uses  all 
exogenous  variables  plus  endogenous  variables  predetermined 
in  the  first  equation  as  instruments.   In  this  sense,  then, 
identification  given  the  prior  information  assumed  in  this 
section,  is  equivalent  to  the  existence  of  2SLS . 
4. 4  An  Example 

Consider  the  example  of  Section  4.1,  with  the  added 
restriction  &2-:>  ~   ^-i  ^  ~  ^ 


^1  =  ^12^2  -^  ^11^1  ■'^l 


^2  = 


Y21Z1  +U2 


^3  =  ^32^2  -^  -^31^1  ""^3' 


where  only  0-.2   -   0-   Here 


(B')"^Zn  = 


11 
0 


ri3. 
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so  that  equations  (2,1)  are  relatively  recursive  and  y^ 
Is  predetermined  in  the  first  equation.   The  order  condi- 
tion (Corollary  ^.3)  is  fulfilled  for  the  first  equation, 
since  there  is  one  explanatory  endogenous  variable  and  one 
restriction.   To  check  the  rank  condition,  there  are  no 
excluded  exogenous  variables,  so  11,  „  =  0.   The  reduced 
form  covariance  matrix  is  given  by 


Q   = 


^11-'^12^22 


^12^22 


•^13"^12^32^22'^^12^23 


'22 


^23~^32^22 


^32^22"2^32^23'^'^33- 


thus 


Qj^   = 


22 


^12^22 


and  ¥=(010) 


'-^13~^12^32'^22'^^12^23' 


The  rank  condition  is  satisfied,  provided  Cpj  ^   Oj  since 


rank 


h2 


=  rank 


=  1  =  g;^  -  1. 


^12^22- 


If  we  treat  yp  as  predetermined  in  the  first  equation,  the 
2SLS  estimate  of  B-,  p  corresponds  to  the  least  squares  estimate 


-  3^  - 


y2^z/2 


Since  Q„  y .  =  Q„  v,-  =  v^-  ,    this  estimator  is  equivalent  to 


^12 ' 

72^2 

"21 

which  converges  in  probability  to  =  B-,-,.   Thus  2SLS 

CO  /-v  /-\        X  ^ 

using  Y2   ^s  an  instrument  yields  the  estimator  obtained  from 
solving  the  reduced  form. 
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5.   Linear  Restrictions  on  (B,r,Z) 

In  the  previous  section,  we  showed  that  for  zero 
restrictions  on  (B,Z-j^)  to  be  useful  for  identifying  (B.,r,) 
they  must  restrict  elements  of  (B')~  li-,  to  be  zero.   Of 
course,  general  homogeneous  restrictions  on  the  vector 
(B')~  E,  are  equally  useful  for  identification  but  are 
ruled  out  by  the  assumption  that  sums  of  products  of  non- 
zero parameters  are  non-zero.   However,  if  we  have  enough 
prior  Information  to  identify  the  parameters  of  equations 
other  than  the  first,  we  can  often  derive  a  homogeneous 
restriction  on  (B')~  Z-,  .   In  this  section,  we  assume  suffi- 
cient information  that  any  equation  might  potentially  be 
identified. 
5. 1   Residuals  as  Instruments 

There  is  one  simple  case  in  which  homogeneous 
restrictions  on  (B')~  2-,  are  available,  and,  paradoxically, 
this  case  is  much  more  relevant  in  practice  than  the  rela- 
tively recursive  structure  In  Section  4. 

Proposition  7:   If  a-,.  =0  and  B.  is  known  or  estimable, 

then  YB .  (or  YB . )  is  predetermined  in  the 

J  J 

first  structural  equation. 
Proof:   Suppose  the  j'th  equation  is  identifiable  and  B. 

J 

is  consistent  for  B..   Then  pllm  ^  B-Y'y^  =  B. (B')"^^^  = 


^Ij  =  °' 


To  be  precise,  by  B.  or  B.,  we  mean  the  coeffl- 

J  J 


clents  of  the  endogenous  variables  in  the  first  equation, 
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after  imposing  normalization  and  other  coefficient  restric- 
tions: i.e.,  E.  =  (1  §.)'.  Note  that  YB .  predetermined  in 
the  first  equation  says  nothing  about  the  status  of  y.  in 

J 

that  equation.   If  equations  (j,l)  are  relative  recursive, 

both  YB .  and  y.  will  be  predetermined  in  the  first  equation; 
J      J 

If  not,  the  former  is  predetermined  and  the  latter  is  not. 
If  the  j'th  equation  is  not  identifiable,  it  is  possible 
that  y.  is  predetermined  but  that  YB .  is  not  calculable, 
and  thus  not  available  as  an  instrument.   Formally,  if  d. 
is  a  G  vector  of  zeros  with  a  1  in  the  j'th  position,  the 
statement  that  both  YB .  and  y.  are  predetermined  in  the 

J  J 

first  equation  can  be  written  as  H'CB')"  E-,  =  0  where 

'  '^ '  . 

¥  =  (d   B.). 
J   J 

Finally,  it  should  be  clear  that  one  can  use 

YB.  or  the  residual  u   Interchangeably  as  an  Instrumental 
J  J 

variable  in  the  first  equation.   Since  i2  is  a  linear  com- 
binatlon  of  the  columns  of  [YB.:Z]  and  orthogonal  to  Z, 
C([YB.:Z])  =  C([u.:Z])  =  C( [a , : YB, : Z ] )  and  either  YB .  or 
u-  (but  not  both)  can  be  used  as  an  Instrument. 

This  case  often  appears  in  practice.   Indeed,  if 
every  equation  (other  than  the  first)  is  identifiable,  then 
every  covariance  restriction  a-,  .  =  0  results  in  an  addi- 
tional instrument,  ^.,    for  the  first  equation.   In  the  limit. 
Corollary  7'1:   If  every  equation  other  than  the  first  is 

identifiable  and  E  is  diagonal,  then  the 
first  equation  is  identifiable. 
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5.2   Rank  Considerations 

Given  the  unlimited  prior  information  assumed  in 
this  section,  it  may  be  the  case  that  the  j'th  equation  is 
identifiable  using  both  coefficient  and  covarlance  restric- 
tions.  While  such  restrictions  aid  in  identifying  the 
first  equation  (by  providing  u.'s  to  serve  as  Instruments), 
they  also  impose  orthogonality  conditions  which  may  undermine 
the  rank  condition. 

Proposition  8:   If  y-,  is  predetermined  in  the  j'th  equation 

(jVl),  u   cannot  be  used  as  an  Instrument  in 
the  first  equation. 

Proof:   That  y-,  is  predetermined  in  the  j'th  equation  implies 

1   ' 
plim  m  y-iU-  =  0  and  a-,  ■  =  0.   Prom  the  first  structural  equa- 
tion, 

^j^l  =  ^j-^l^l  -^  ^j^l 

1    /N  »  1       ' 

so  that  plim  =7  u.X-,  =  plim  „  u.X,  =  0.   As  an  Instrument, 
u.  Is  orthogonal  to  the  explanatory  variables  in  the  first 
equation  and  is  therefore  useless.   Specifically, 

plim  ^  y'G.  =  0  =^  plim  ^  u'.Y   =  0 

1 

=>  B.fi-,  =  0. 

Thus  knowledge  of  B.  does  not  contribute  to  the  rank  condl- 
tion  in  Corollary  ^.2. 
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Corollary  8.1:   If  y,  is  predetermined  in  the  j'th  equation, 

u.  cannot  be  used  as  an  instrument  for  y,  in 

J  K 

the  first  (or  any  other)  structural  equation, 

1   ' 
The  proof  follows  from  the  fact  that  plim  m  y  Uj  =  0. 

-•■   k  J 

5. 3  Examples 

The  simplest  example  of  this  case  is  the  supply 
and  demand  model  from  the  Introduction,  which  we  repro- 
duce below 


yi  =  3i2y2  +  -Yii^i  +  ^1 

^2  ^  ^21^1         ■''  ^2 

where  a^2   ~   ^-      Here  the  second  equation  is  identifiable  by 
coefficient  restrictions  alone,  but  equations  (2,1)  are  not 
relatively  recursive  (Bp-iT^O)  so  that  y^   is  not  predetermined 
in  the  first  equation.   However,  up  is  a  legitimate  instru- 
ment in  the  first  equation;  given  our  consistent  estimate 
of  321, 

^2Al-'^12    ^21^^1l''^12^22^-^^21^1l"'^12^22) 


^2l"l2-'^22    ^21^^21^1l"'^12^22^-^^2l''ll''^22^ 


2 

^22^^21^12"^12^  _ 

^22^^21^12"^^     ^^' 


Thus  the  restriction  c-jp  =  0  identifies  3-|2>  ^^'^   ^he  above 
consistent  estimator  is  easily  seen  to  be  equivalent  to 
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(y2-32iyi)'Q2  Yi 
g   =  1 

(y2-B2iyi)'Q2^y2 


the  instrumental  variables  estimator  for  B-,2  in  the  demand  - 
equation,  using  (y2"B21'^l^  ^^  ^^   instrument. 

In  addition  to  the  above,  Fisher  uses  two  examples 
in  (1966),  Chapter  4.   To  illustrate  the  sufficiency  condi- 
tion. Theorem  4.7.1,  consider  (Fisher,  I966,  pp.  111-112): 

y^+B^2y2-'^13^3^      ^1222-'^13^3  =  ^1 

32iyi+   y2-'^23^3'"^21^1-'      ^23^3  =  ^2 

^31^1"^^ 32^ 2"*"   ^3"^      ^32^2       ^  ^3 

where  a,  2  =  o-,  q  ~    0-   Since  there  are  no  restrictions  at 
all  on  B  (except  3..  =  1),  y.  is  not  predetermined  in  equa- 
tion j  (ijj  =  1,2,3)  by  Proposition  2.   Equation  3  is  identi- 
fiable (with  probability  one)  by  coefficient  restrictions 
alone,  but  equations  1  and  2  are  not:   Z,  and  Z_  provide 
the  necessary  instruments  for  the  third  equation  and  the 
first  two  equations  are  each  one  instrument  short.   Using 
the  covarlance  restriction  a,^  =  0,  u-^  (or  ^ on Y-i ''■602^2"*'^?^ 
is  predetermined  in  equation  1;  since  y-,  is  not  predeter- 
mined in  equation  3,  u^  Is  a  legitimate  instrument  in  the 
first  equation,  identifying  it  by  Corollary  4.2.   Finally, 
a,  p  =  0  implies  that  u-,  is  predetermined  in  the  second 
equation,  which  again  is  identifiable  by  Corollary  4.2. 
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A  similar  example  illustrates  Theorem  4.8.1  -  a 
necessary  and  sufficient  condition  for  identifiability , 
given  that  there  are  no  coefficient  restrictions  on  the 
first  equation:   (Fisher,  1966,  pp.  116-117). 

yi+6l2y2-'^13y3'"^ll^l''^1222  =  ^1 


e2i+yi+    ^2^ 


^22^2    ^2 


63iyi+e32y2+  ys'^^si^i 


=  u. 


where  a-,  o  =  ct-, ->  =  Op^  =  0.   Here,  equation  2  is  identifiable 
by  coefficient  restrictions  alone,  equation  3  is  identi- 
fiable, using  Up  as  an  instrument,  and  equation  1  is  iden- 
tifiable  using  Up  and  u-,  as  instruments.   This  follows  from 
Corollary  4.2,  noting  that  since  there  are  no  coefficient 
restrictions  on  the  first  equation,  the  rank  condition 
becomes  rank['i'f^-,  ]  >_  g-,  -  1,  or 


rank 


321  1  ° 


^31  ^32  IJ 


w 


11 


w 


12 


0) 


13 


=  2  =  g,  -  1, 


1   /v  '  1   '^  ' 

provided  plim  m  UpY,  7^  0  and  pllm  „  ^0^-1  7^  0. 

A  final  example  illustrates  failure  of  the  rank 
condition  when  the  order  condition  holds: 
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Yl  +         6i3y3  +  zr^  =  u^ 

621^1  ■*■   ^2    "^  ^23^3  "^  ^^2  "  ^2 

^31^1  "■  ^3  ■"  ^^3  =  ^3 

and  a-|2  =  02-0   ~  ^ir>   -   '^^      Using  Proposition  2,  it  is  easily 
shown  that  y-,  and  y^  are  predetermined  in  the  second  equa- 
tion and  that  no  other  y.  is  predetermined  in  any  equation. 
If  their  respective  equations  are  identifiable,  Up  is  pre- 
determined in  equations  1  and  3,    and  (u-,  ,Un)  are  predeter- 
mined in  equation  2.   However,  since  (y-,  ,yo)  are  predeter- 
mined in  the  second  equation,  u^  cannot  be  used  as  an  instru- 
ment in  equations  (1,3)  by  Proposition  8.   Thus  the  parameters 
of  the  second  equation  are  the  only  identifiable  parameters 
of  the  system,  despite  the  fact  that  the  order  condition 
(Corollary  4.3)  holds  in  equations  (1,3) 

To  see  this  in  terms  of  the  mapping  between  the 
structure  and  the  reduced  form,  observe  that  the  instrumental 
variables  estimator  of  g,-,  is  given  by 


^13 


^  ^2Qzyi  ^  g2Al'""l2-'^23"l3 
^2V3   §2l''l3''''23''^23''33 


It  is  straight-forward  but  tedious  to  check  that  both  the 
numerator  and  denominator  of  B-^o   is  zero.   This  verifies 
the  observation  in  the  proof  of  Proposition  8: 
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rank 


^12 


,  ¥J^^ 


=  rank  (82^^-,)  =  rank  (22l"ll''"'^12"*'^2^'^l'^^ 
=  0  <  g,  -  1  =  1, 


so  that  the  failure  of  Up  as  an  Instrument  in  equation  1 
implies  failure  of  the  rank  condition  in  Corollary  4.2. 
Despite  the  fact  that  the  order  condition  is  fulfilled, 
the  parameters  of  equation  1  are  not  identifiable. 
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6.   Summary 

Identlflablllty  of  the  first  structural  equation 
is  equivalent  to  the  existence  of  a  unique  solution  (B^jT-,  ) 
to  the  equations  which  link  the  structural  parameters  and 
the  reduced  form  parameters 


HB,  =  -r. 


fiB^  =  (B'  )~^2j_ 


(i=l,.,.,G) 


We  saw  that  coefficient  or  disturbance  covariance  restric- 
tions are  useful  for  identification  if  they  restrict  the  set 
of  solutions  (B-,,r,)  above.   It  follows  (Lemma  4)  that 
covariance  restrictions  on  (B,E-,)  are  useful  for  identifi- 


cation if  and  only  if  they  identify  elements  (or  linear 
combinations  of  elements)  of  (B')~  Z  ;  this,  in  turn,  is 


equivalent  to  the  existence  of  linear  combinations  of  the 
endogeneous  variables  which  are  predetermined  in  the  first 
equation.   Thus  all  restrictions  which  are  useful  for  iden- 
tification correspond  to  instruments  which  can  be  used  for 
estimation.   This  extends  the  intuition  for  coefficient 
restrictions  -  developed  in  Fisher  (1966),  Theorem  2.7-2  - 
to  the  totality  of  useful  restrictions. 

This  approach  also  yields  necessary  and  sufficient 
conditions  for  identifiabllity  in  linear  models  with  linear 
coefficient  and  covariance  restrictions  (Proposition  4)  - 
a  result  which  eluded  Fisher,  except  in  special  cases.   In 
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practical  terms,  the  result  boils  down  to  two  useful  cases: 
(i)    equations  (j,l)  are  relatively  recursive  and  y.  is 

predetermined  in  equation  (1),  and 
(li)   equation  (j)  is  Identifiable,  a, .  =  0,  and  a.    is  pre- 
determined in  equation  (1). 
The  prior  information  embodied  in  (i)  is  qualitatively  no 
different  than  that  required  to  assert  that  Z-,  is  exogenous 
in  the  model;   that  involved  in  (ii)  is  even  less.   In 
addition,  if  the  parameters  of  the  first  equation  are  over- 
identified,  the  restrictions  implied  by  (i)  and  (ii)  can 
be  tested  by  a  specification  test  described  in  Hausman-Taylor 
(1980).   Briefly,  the  test  compares  2SLS  estimates  of  the 
structural  parameters  of  the  first  equation  using  and  omitting 
the  instruments  described  in  (1)  or  (ii).   If  the  point  esti- 
mates differ  by  more  than  sampling  error,  we  reject  relative 
recursiveness  in  (i)  or  the  hypothesis  a,.  =  0  in  (ii),  while 
the  maintained  hypothesis  is  the  remaining  prior  information. 

Finally,  the  approach  suggests  a  way  of  incorpor- 
ating covariance  restrictions  into  3SLS  or  FIML  estimation. 
Since  useful  covariance  restrictions  imply  that  endogenous 
variables  may  be  treated  as  predetermined,  it  might  be  con- 
jectured that  using  those  instruments  imposes  the  required 
restrictions  in  estimation.   This  is  indeed  correct  and  the 
full  solution  to  the  estimation  problem  with,  covariance 
restrictions  is  worked  out  in  a  companion  paper,  Hausman- 
Taylor  (1981). 


Appendix  A 

Lemma:   (B')ij  =  0  If  and  only  If  equations  (l,j)  are  rela- 
tively triangular. 
Proof:   (B')^,-  is  proportional  to  the  minor  |B..|  which  is 
the  determinant  of  the  matrix  B..  formed  by  striking  out 
the  j'th  row  and  i'th  column  of  B'.   |B..|  is  defined  as 

the  sum  of  the  (G-1)!  distinct  terms  formed  by  multiplying 

t 
together  G-1  elements  of  B..,  exactly  one  from  each  row  and 

column,  with  a  rule  for  determining  the  sign. 

Let  Br.~%n  denote  the  set  of  all  chain  products 
Ll  J  J  J 

containing  exactly  (G-p)  elements  of  B...   In  each  chain 

product,  exactly  p-1  indices  do  not  appear;  call  them 

(mT,m„,...,m   ,).   Let  Br  -,  represent  the  set  of 

12'     p-1         {m-,,...,m  ,  } 

±  ^~  t 

all  products  of  (p-1)  elements  of  B..  -  with  exactly  one 

from  each  row  and  column  indexed  by  (m-,  ,  .  ,  .  ,m  -,  ) .   Finally, 

multiply  each  chain  product  in  Bp.~?n  by  one  of  its  associated 

m.embers  of  Br  -,  and  denote  the  sum  of  all  such  terms 


^^  ^K?:?]«  V'-'-'Vi'' 


p- 

Two  characteristics  of  the  series 


Z[B^?"P^  8  Br  ,] 

[i,J  ]     im-^_, .  .  .  ,m_  -,  }-■ 


5  ' 


P-1' 


are  important: 

(i)  It  contains  (G-2)!  distinct  terms. 

An  element  of  bL"?!  is  uniquely  specified  by 
listing  the  G-p-1  unfixed  column  indices  of  the  elements. 


A- 2 


since  the  chain  property  then  determines  the  row  indices. 

The  first  row  index  is  i,  the  final  column  index  is  J  and 

(i,j)  appear. in  no  other  index.   The  first  column  index 

can  be  chosen  (G-2)  different  ways,  the  second,  (G-3) 

different  ways,  etc.,  so  that  there  are  (G-2)x(G-3)><.  .  •  >< 

(G-(G-p+l))  =  (G-2) !/(p-l) !  different  elements  InB^?"?^. 

Similarly,  reordering  the  elements  of  Br  -,  so  that 

im^,...,m  -j_> 

the  row  indices  increase  from  left  to  right,  the  first 

column  index  can  be  chosen  (p-1)  different  ways,  etc.   The 

number  of  distinct  elements  of  Br  -i  is  thus  (p-1)!, 

{m-,  , .  .  .  ,m^  T  }  '-^   '  ' 

(Q     ^)  1  P-1 

so  that  the  series  i:[Br!:  .<  8  Br  -,]  contains  (G-2)! 

LljJ  J      i-^-i  J  •  •  •  '^n  —  T-'^ 

distinct  terms. 

(ii)  Each  term  is  a  product  of  (G-1)  elements  of  B..  with 
exactly  one  element  from  each  row  and  column. 

This  is  derived  from  the  definition  of  a  chain  pro- 
duct and  the  construction  of  the  residual  product  Br       „   i 

im^, . . . »m  i> 

Now  consider  the  following  expansion  for  the  minor 


i^ji 


|Bni=   ^-[U\ 


±    Z  bJ?  ?^  8  Br   -,  ±  .  .  . 

±  E  B^?-P^  8  Br       ^    T  ± 

±  I   BrJ"^  -n  8  Br  ,  . 

Li, J  J    im^, .  .  .  >niQ_2-f 
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That  is,  we  expand  |B.j_|,  organizing  terms  by  the  length  of 
the  [i,j]  chain  product  they  contain.   To  verify  that  this 
equals  |B.j^|,  observe  that 
(i)    terms  in  different  rows  in  the  expansion  are  distinct 

since  they  contain  chain  products  of  different  lengths, 

and 
(ii)   there  are  (G-1)  rows,  each  containing  (G-2)!  distinct 

terms. 

The  expansion  thus  represents  the  sum  of  (G-1)!  distinct 

terms,  consisting  of  products  of  G-1  elements  of  B..  with 

one  element  from  each  row  and  column  in  each  term.   Up  to 

the  sign  rule  for  each  term,  then,  equation  (A.l)  is  a  valid 

expansion  for  the  m.inor  lB..|.   Since  we  are  only  interested 

in  |B.. I  =  0  and  have  ruled  out  the  possibility  that 

^[Brj  ?n  8  Br  -,  ]  can  equal  zero  unless  each  term 

[i,j]     {m^,.  .  .  ,m.p_^}^      ^ 

is  zero,  the  sign  rule  for  each  term  is  irrelevant  for  our 

purposes. 

The  Lemma  follows  immediately  from  the  expansion 

(A.l).   Every  term  in  the  expansion  contains  an  element  of 

Br.  . -, ,  so  that  Br.  . -,  =  {0}  is  obviously  sufficient  for 

1b.,1  =  0.   For  necessity,  every  distinct  chain  product 

Br.~?n  appears  once  in  a  term  in  (A.l)  with  residual  elements 

of  the  form  11(3    ),  and  in  the  usual  normalization  for 
m.m. 
1   11 

simultaneous  equations  systems  n(B     )  =  1.   Thus  if  any 

1  i 


chain  product  differs  from  zero,  at  least  one  term  in  (A.l) 


1 

differs  from  zero  and  -  by  assumption  -  [B.^^I  ¥■    0, 


Appendix  B 

Let 

Y  =  XB  +  e 
(B.l) 

R6  =  0 

be  a  canonical  linear  regression  model  with  parameters  sub- 
ject to  r  homogeneous  restrictions.   (The  extension  to  non- 
homogeneous  restrictions  Is  straightforward.)   Let  R  denote 
the  r  dimensional  subspace  of  1/  -  the  column  space  of  X  - 
spanned  by  the  columns  of  X(X'X)~  R' .   Similarly,  R]_[/   denotes 
the  orthocomplement  of  R  in  V,    and  P.  denotes  the  orthogonal 
projection  operator  onto  the  column  space  of  A.   Using  the 
Identity  X  =  ?« i  (»X  +  Pj,X  and  the  restrictions,  equation  (B.l) 
becomes 

(B.2)  Y  =  P^ii/XB  +  e 

since  PpXB  =  0.   The  least  squares  estimates  of  B  in  equation 
(B.2)  are  the  restricted  least  squares  estimates  of  B  in 
equation  (B.l).   Since  the  design  matrix  in  equation  (B.2) 
is  singular  (of  rank  p-r),  we  re-parameterize  the  equation  as 

(B.3)  Y  =  Z6  +  e 

where  Z  is  a  Tx(p-r)  matrix  whose  columns  span  R}_\/ .      Least 
squares  estimates  of  6  are  related  to  restricted  least 
squares  estimates  of  B  by 

6  =  (Z'Z)"^Z'XBpLS'  ^RLS  "  (X'X)"^X'Z6. 
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To  estimate  6  in  equation  (B.l)  by  2SLS  subject 
to  the  restrictions,  we  need  only  (p-r)  Instruments  for 
the  columns  of  Z,  not  p  instruments  for  the  columns  of  X. 
Thus  if  W  denotes  the  matrix  of  instruments,  a  necessary 
and  sufficient  condition  for  the  identifiability  of  6  is 
that  Z'P^Z  be  non-singular,  so  that  2SLS  estimates  of  6 
are  well-defined. 


Footnotes 


1.  We  wish  to  acknowledge  useful  comments  from  F.  Fisher 
and  R.  Radner. 

2.  The  following  results  are  easily  extended  to  the  case 
of  general  linear  restrictions  on  both  coefficients 
and  covariances. 

3.  Since  we  have  ruled  out  the  possibility  that  sums  of 
non-zero  terms  are  zero. 
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